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their  Decomposed  Function  Cardinality  (DFC)  with  their  Lyaponov  exponent. 
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1  Introduction 

This  memo  documents  the  results  of  Pattern  Theory  2  Task  Order  3.  The  objective 
of  this  task  was  to  decompose  a  set  of  logistic  functions.  In  our  prior  experiments 
into  the  phenomonology  of  function  decomposition  (reported  on  in  Pattern  Theory: 
An  Engineering  Paradigm  For  Algorithm  Design  WL-TR-91-1060),  we  decomposed  a 
wide  variety  of  non-chaotic  functions.  The  logistics  functions  decomposed  in  this  task 
represent  our  first  look  at  the  ability  of  decomposed  function  cardinality  (DFC)  to 
measure  complexity  (or  patternness)  in  a  chaotic  function.  For  each  logistic  function 
that  we  decomposed,  we  also  calculated  an  approximation  of  the  Lyaponov  Expo¬ 
nent,  a  common  measure  of  complexity  in  chaotic  functions,  and  then  computed  the 
correlation  between  DFC  and  the  Lyaponov  Exponent  over  all  functions. 

2  Background 

2.1  Introduction  to  Pattern  Theory 

Pattern  Theory  is  primarily  an  approach  to  solving  the  basic  problem  of  algorithm 
design:  to  begin  with  some  abstract  definition  of  a  function  (i.e.,  a  formula,  a  table 
of  values,  a  set  of  samples,  etc.)  and  to  end  with  a  computer  algorithm  that  realizes 
that  function.  It  is  our  contention  that  what  makes  this  problem  solvable  is  the 
existence  of  some  structure  in  the  function  that  we  call  ‘pattern  ness’  and  that  if 
we  can  automate  the  process  of  discovering  the  underlying  pattern  in  any  patterned 
function,  we  can  then  automate  the  process  of  algorithm  design. 

There  is  a  ‘common  sense’  recognition  that  patterns  occur  in  many  forms:  strings, 
sequences,  images,  etc.  It  seems  that  patterns  are  easier  to  remember,  easier  to 
extrapolate,  and,  also,  easier  to  describe  in  a  simplified  form.  This  last  concept  relates 
pattern-ness  to  simplicity,  or  the  inverse  of  complexity,  and  it  is  this  concept  we  have 
chosen  to  focus  on  for  two  reasons.  Firstly,  computational  complexity  already  has 
a  well  developed  theory,  and,  secondly,  it  is  quantifiable.  There  are  many  measures 
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of  computational  complexity.  We  feel  that  the  one  we’ve  chosen,  DFC,  captures 
the  essence  of  complexity  in  the  sense  of  patterns.  In  the  above-mentioned  TR,  the 
generality  of  DFC  was  supported  both  theoretically,  by  relating  it  to  time  complexity, 
program  length,  and  circuit  complexity,  and  experimentally  by  decomposing  more 
than  1000  different  functions  of  various  types  and  different  degrees  of  pattern-ness. 

2.2  Function  Decomposition 

The  decomposition  of  binary  functions  was  first  described  by  R.  L.  Ashenhurst  in 
1958.  The  first  textbook  on  the  subject  was  A  New  Approach  to  The  Design  of 
Switching  Circuits,  by  H.  L.  Curtis  published  in  1962.  By  “function”,  we  mean  the 
traditional  mathmatical  function;  a  set  of  ordered  pairs  {x,f[x))  so  that  for  every 
X  there  is  exactly  one  f{x).  In  general,  functions  may  have  more  than  one  variable: 
{f{x,y,z)).  The  decomposition  of  a  function  is  an  expression  of  that  function  in 
terms  of  a  composition  of  other  functions.  Suppose 


f{xuX2,...,Xe)  =  F[0[<^(*i,I2),A(®3,*4)],t/)(®5,®6)] 


then  the  RHS  is  the  decomposition  of  /. 

Decomposing  binary  functions  was  of  particular  use  in  reducing  the  number  of 
circuit  elements  in  switching  circuit  designs  in  the  early  1960’s.  The  method  suggested 
by  Curtis  is  useful  for  decomposing  functions  of  five  variables  or  less,  but  functions 
of  six  variables  are  difficult  to  decompose  by  hand,  and  functions  of  seven  varibles 
or  more  are  intractable.  In  the  summer  of  1989,  Chris  Vogt  and  Michael  Noviskey 
design»*d  and  wrote  a  program  in  Ada  which  can  decompose  binary  functions  of  up 
to  ten  variables.  We  refer  to  it  as  the  Ada  Function  Decomposer  (AFD)  and  it  has 
ten  versions  which  each  approach  the  decomposition  process  with  slightly  different 
heuristics.  On  the  AART  VAX  11/780  it  takes  between  half  an  hour  and  three  hours 
to  decompose  a  typical  8  variable  function  using  the  fastest  version.  A  ten  variable 
function  might  take  several  days.  This  program  was  used  to  produce  the  experimental 
results  presented  in  this  paper. 

3  The  Logistic  Map 

The  Logistic  Map  is  composed  of  a  group  of  functions  dependent  on  a  constant  p. 
which  are  of  the  form: 

F^(a:.+i)  =  p(x.  -  x^) 

where  p  is  a.  real  number  less  than  4.0.  For  any  p,  an  initial  value  for  x  can  be  chosen 
between  zero  and  one.  Each  successive  x  is  then  dependent  upon  the  preceeding  x 
and  is  also  bounded  between  zero  and  one. 

For  values  of  p  less  than  3.0,  the  sequence  will  converge  to  a  single  point.  When 
p  is  slightly  greater  than  3.0,  the  sequence  will  converge  to  two  points  between  which 
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Figure  1:  The  Logistic  Map 

it  will  oscillate.  For  increasing  values  of  (i  up  to  approximately  3.5,  the  sequence 
converges  to  a  fixed  number  of  points  (first  four  and  then  eight)  between  which  it 
oscillates.  For  greater  than  approximately  3.55,  there  are  regions  in  which  the 
sequences  are  chaotic.  Although  the  values  in  these  chaotic  sequences  are  bounded, 
the  sequences  never  converge  to  any  finite  number  of  points.  Interestingly,  for  a 
few  discrete  values  of  fi  greater  than  3.55,  regions  of  stability  again  arise  where  the 
sequences  will  converge  to  a  number  of  fixed  points,  but  in  these  ‘post-chaos’  regions, 
the  number  of  fixed  points  is  always  odd,  rather  than  being  a  power  of  two. 

A  plot  of  the  two-dimensional  ‘logistic  map’  as  it  is  commonly  shown  is  repro¬ 
duced  in  figure  3.  The  sequences  were  produced  by  choosing  an  initial  x  =  .25  and 
eliminating  the  first  200  transient  terms. 

4  The  Experiment 

There  were  two  considerations  in  the  design  of  the  experiment.  The  first  was,  which 
particular  functions  from  the  logistic  map  should  we  choose  to  decompose?  Because 
the  decomposition  process  takes  a  significant  amount  of  time,  we  had  to  be  fairly 
selective  in  our  choice  of  /i’s.  The  second  was,  how  best  should  we  translate  these 
sequences  of  real  numbers  into  binary  functions  which  we  can  decompose? 

After  some  discussion,  we  initially  chose  roughly  forty  values  for  p  which  fell  into 
four  general  categories: 

1.  3.5  to  3.9  at  an  interval  of  tenths  and  one  point  at  3.99 

2.  3.61  to  3.85  at  an  interval  of  hundreths 
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3.  3.775  to  3.785  at  an  interval  of  thousandths 

4.  3.825  to  3.835  at  an  interval  of  thousandths 

The  first  group  was  chosen  to  give  a  broad  look  at  the  generally  increasing  com¬ 
plexity  in  the  logistic  map.  We  were  primarily  concerned  with  the  area  of  the  logistic 
map  which  was  chaotic,  so  values  for  /i  less  than  3.5  were  not  used.  The  second  group 
was  chosen  to  obtain  a  finer  resolution  in  the  chaotic  region.  At  this  point,  enough 
detail  is  provided  to  see  variations  in  complexity  within  the  chaotic  region.  The  last 
two  groups  were  chosen  specifically  to  compare  the  DFCs  of  the  functions  in  each 
tight  region  to  the  Lyaponov  exponents  for  functions  there.  It  was  known  a  priori 
(and  it  is  obvious  from  looking  at  the  logistic  map)  that  in  the  first  narrow  region 
(3.775  to  3.785)  the  Lyaponov  exponent  is  relatively  high,  indicating  a  good  deal  of 
complexity,  and  also  that  in  the  second  region  (3.825  to  3.835)  there  is  a  sudden  dip 
in  the  Lyaponov  exponent  indicating  a  decrease  in  function  complexity. 

Each  of  these  sequences  was  generated  in  the  same  way  that  the  logistic  map  was 
generated;  Iq  was  chosen  to  be  .25,  and  the  first  200  transient  terms  were  eliminated. 
A  discussion  of  our  confidence  that  the  initial  value  chosen  for  x  would  change  the 
binary  function  resulting  from  the  sequence,  but  would  not  have  an  effect  on  the  DEC 
of  the  function,  is  presented  in  Appendix  B. 

We  answered  the  second  consideration  by  using  the  same  general  method  described 
in  our  Pattern  Theory  report  when  we  decomposed  other  (non  chaotic)  sequences: 
The  first  step  was  to  translate  the  sequences  of  real  numbers  into  sequences  of  binary 
numbers.  There  are  several  ways  to  do  this;  in  this  case  we  applied  a  simple  threshold: 
if  the  nth  number  in  the  real  sequence  was  greater  than  .5  then  ths  nth  number  in  the 
binary  sequence  was  chosen  to  be  1;  if  the  nth  number  in  the  real  sequence  was  less 
than  or  equal  to  .5,  the  nth  number  in  the  binary  sequence  was  chosen  to  be  0.  The 
second  step  then  was  to  translate  the  binary  sequence  into  a  binary  function.  This  was 
simply  done  by  allowing  each  succeeding  number  in  the  sequence  to  be  the  succesive 
output  of  a  function  with  a  number  of  binary  inputs  equal  to  log2  of  the  number  of 
elements  in  the  sequence.  We  chose  to  decompose  sequences  of  256  elements  each. 
This  translated  the  sequences  into  functions  of  eight  binary  variables  where  the  nth 
element  in  the  sequence  was  defined  to  be  /(ij , . . . ,  xg)  where  x[  -f  . . .  -f  1 

Although  some  information  is  lost  by  doing  this  sort  of  transformation,  a  rea¬ 
sonable  amount  of  information  is  still  retained.  For  example,  the  binary  sequence 
arising  from  the  logistic  function  for  =  3.5  is  a  repetition  of  ‘0111’,  a  cluster  which 
captures  the  fourness  of  the  double  bifurcation  at  that  point  in  the  logistic  map.  At 
around  /i  =  3.83  the  binary  sequence  becomes  a  repetition  of ‘Oil’,  a  similarly  simple 
cluster  which  captures  the  threeness  of  the  logistic  map  at  this  point  inside  the  region 
of  chaos.  In  other  regions  where  more  complexity  exists,  there  are  no  such  simple 
analyses  of  the  binary  functions;  however,  there  still  exists  a  sense  of  the  movement 
from  the  upper  to  the  lower  half  of  the  logistic  map. 
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Figure  2:  DFC  Values  vs  n  for  Logistic  Map 
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Once  these  decisions  were  made,  a  short  program  was  written  in  Turbo  Pascal 
to  produce  the  binary  functions  corresponding  to  the  chosen  values  of  y,.  The  func¬ 
tions  were  then  decomposed  using  the  quickest  AFD  algorithm.  In  cases  where  the 
DFC  seemed  unusually  high,  a  few  functions  were  decomposed  again,  using  a  more 
exhaustive  version. 

4.1  The  Results 

The  actual  DFC  values  obtmned  for  each  region  explored  are  shown  graphically  in 
the  chart  included  in  Figure  ??.  The  first  thing  to  notice  is  that  decompositions  were 
found  for  many  of  the  sequences  in  the  chaotic  region,  thus  demonstrating  the  gener¬ 
ality  of  DFC  as  a  measure  of  complexity.  It’s  visually  apparent  that  the  complexity 
of  the  logistic  map  increases  as  one  moves  toward  the  right,  and  if  you  follow  the 
DFC  values  corresponding  to  /i  =  3.5, 3.6  .. .  3.99  you  will  notice  that  they  do  show  a 
steady  increase.  The  intervals  of  hundreths  between  DFC  values  give  us  a  fairly  clear 
picture  of  the  existence  of  regions  of  stability  within  the  chaotic  region.  Although 
there  is  an  overall  steady  increase  in  DFC  with  increasing  /r,  there  are  some  values 
of  fi  (notably  3.63,  3.74  and  3.83)  where  the  DFC  suddenly  drops.  A  quick  glance  at 
the  logistic  map  will  show  that  these  arc  the  same  places  where  the  functions  become 
visibly  less  chaotic. 

In  Chaotic  Dynamics  of  Nonlinear  Systems,  S.  Neil  Rasband  suggests  that  the 
Lyaponov  exponent  is  a  good  indicator  of  chaos.  Our  experiments  have  shown  that 
there  is  a  strong  correlation  between  the  DFC  values  and  the  Lyaponov  exponent. 
The  Lyaponov  exponent  for  the  logistic  map  is  shown  graphically  in  Figure  ??.  For 
the  values  of  /i  chosen  in  the  third  group  of  functions,  the  Lyapononv  Exponent  is 
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Figure  3:  Lyaponov  Exponent  vs  /x  for  Logistic  Map 

Lyapunov  exponent  for  Logistic  map. 

)0OO  t*rms  •umm«d,  stop  slz*  •  0.0082S 


3  6  3.7  3.9 


fairly  stable  and  relatively  high.  The  average  DFC  over  the  region  was  224  (87.5 
%DFC)  and  similarly  stable.  By  contrast,  for  the  values  of  /x  chosen  in  the  fourth 
group,  the  Lyaponov  exponent  is  low  with  a  sharp  dip.  The  average  DFC  over  the 
fourth  region  was  only  118  (46.1  %DFC)  and  there  is  also  a  sharp  dip  in  precisely  the 
same  place:  /x  =  3.832. 

In  the  course  of  the  experiment,  49  different  functions  were  produced  and  decom¬ 
posed.  After  the  decomposition  was  complete,  we  computed  an  approximation  of  the 
Lyapononv  exponent  for  each  value  of  and  calculated  the  overall  correlation.  It  was 
found  to  be  .904.  Further  statistical  analysis  of  the  relationship  between  DFC  and 
the  Lyaponov  exponent  is  shown  in  Figure  ??. 

The  obvious  and  significant  conclusion  to  be  drawn  from  the  experiment  is  that 
DFC  is  a  robust  measure  of  complexity  for  chaotic  as  well  as  non-chaotic  functions. 
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Figure  4:  DFC  and  L.E. 
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/Appendix 


It  can  be  easily  demonstrated  that  logistic  functions  which  converge  to  a 
single  puiul  or  a  finite  and  small  number  of  points  will  exhibit  this  convergence 
regardless  of  the  initial  value  chosen  for  z.  However,  demonstrating  that  a 
chaotic  logistic  function  retains  the  same  degree  of  complexity,  independent 
of  the  initial  z,  is  a  little  more  difficult.  When  the  value  of  /x  is  sufficiently 
great  that  the  function  will  not  converge  to  any  finite  sequence,  different  initial 
z’s  will  always  generate  completely  different  infinite  sequences.  We  know  that 
the  Lyapunov  exponent,  which  is  a  common  measure  of  complexity  in  chaotic 
systems,  is  completely  independent  of  the  initial  z,  so  we  felt  it  would  be  good 
to  check  whether  or  not  the  DFC  for  any  given  /x  was  dependent  on  the  initial 
z. 

We  chose  fi  =  3.8  and  generated  four  sequences,  using  initial  z’s  of  0.25, 
0.4,  0.6  and  0.8  and  eliminating  the  first  200  elements.  The  functions  were 
named  ‘log38’,  log38a’,  ‘log38b’  and  ‘log38c’  respectively.  The  decompositions 
are  shown  on  the  following  pages.  Although  the  functions  are  clearly  different 
and  chaotic,  it  is  also  clear  that  they  decompose  to  the  same  cost  and  in  exactly 
the  same  way. 
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1011010111011101010110111110101011111111111010110111101011111111 
1111111011111101101011101111010101101011101111101110101111011011 

lost  -  256 


Better  decomp  found 

7  8  10  11  12  9 

11011010011101111001111101111100 
Cost  -  32 

1  2  3  4  5  6  1( 

0000000110110010000000011000101110000110001110000100010011111101 

Cost  -  64 

1  2  3  4  5  6  1; 

00001010010100101 lOOOOlOOOC 10000010010101110001 1111 001 1110011 000 

C  n  s  C  •  ^4 

1  2  3  4  5  6  1; 

01 1 101 101 1000101 1001 10 luOl 101 001001 1000011 001 01 11 01 1001 01 0000010 

Cost  »  64 

Decomposition  cost:  224 

Node  Information: 

0  1  2  3  4  5  f 

1  4  0  0  0  0  ( 

CPU  Time: 

88.71 


CPU  Time; 

97.82 

Node  Information; 

0  1  2  3  4  5  f 

1  4  0  0  0  0  ( 


SPECIFY  FUNCTION  TABLE  VALUES: 


Enter  0  to  input  from  a  file,  1  from  terminal, 

or  2  to  QUIT  program:  Thank  you  for  using  the  PBML  function  Decomposer 


